t N79- 15598 


CLOSED LOOP MODELS FOR ANALYZING 
THE EFFECTS OF SIMULATOR CHARACTERISTICS* 

by 

Sheldon Baron, Raaal Muralidharan, David Kleinman 
Bolt Beranek and Newman Inc. , Cambridge, MA 

ABSTRACT 


The optimal control model (OCM) of the human operator is used to develOD 
closed-loop models for analyzing the effects of (digital) simulator 
characteristics on predicted performance and/or workload. Two approaches are 
ooo.ld.rM: tlw first otlllM. . oontlouou. ,ppro«i..tlon to th. dl.o4u 
simulation in conjunction with the standard optimal control model: the second 
involves a more exact discrete description of the simulator in a closed-loop 
multi-rate simulation in which the optimal control model "simulates" the pilot; 
Both models predict that simulator characteristics can have significant effects 
on performance and workload. 8 


1. INTRODUCTION 


? deyeiopment of engineering requirements for man-in-the-loop digital 
i* * . cc ® plex taak involving numerous trade-offs between simulation 
fidelity and costs, accuracy and speed, etc. The principal issues confronting 
the developer of a simulation involve the design of the oue (motion and visual) 
environment so as to meet simulation objectives and the design of the digital 
simulation model to fulfill the real-time requirements with adequate accuracy. 

i the ai " ulation ood<!l has become increasingly important and 

real-time d^^V 0 ^*'' 8 * °° re oentraX ™le in the simulations. For 

real-time digital simulation with a pilot in the loop the de-sign problem 

dimc^ete lodti^r Vh? ° f ® onvaraion a< >uipment (A-D and D-A) as well as. of the 
JT f 1 1 h f * y , 8tC “ dyn#J8ica - T he design of an adequate discrete 

errors 1 and ! cl ° 5cl * \° tha oue generation problem inasmuch as the 

particular, the delays introduced by the simulation will be 

nrnhiMi h” ^ infor * atXon cu ® 8 utilized by the pilot. The significance of this 

?o£ b i!S.^ 8 .H b88 » n *", ply <le " ona * r »t*<»* 1 » 2 Of course, human pilots can compensate 

efr«ot°!? nn 8b °: tC “ ing8 ** we ! 1 M for thoae of ou * generation, with possible 
effects on the subjeotive evaluation of the simulation. 

.m.imIi 18 °^ c , cti 1 ve of tba work reported here was to develop a closed loop 
analytic model, incorporating a model for the human pilot (namely, the optimal 
control model), that would allow certain simulation design tradeoffs to be 
evaluated quantitatively and to apply this model to analyze a realistic flight 
control problem. The effort concentrated on the dynamic, dosed loop aspects of 


•The work described herein was performed under Contract No. NSAi-UUtta r™ 
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the simulation. Problems associated with perceptual issues in cue generation 
were not considered. However, the limitations imposed by the dynamics of visual 
. cue generation equipment are considered and the model can be readily extended to 
incorporate the dynamics associated with motion simulation. 

The optimal control model of the human operator^ 1 * is central to^ the closed 
loop analysis techniques that have been employed. This model has been validated 
and applied extensively and has a structure that is well-suited to analysis of 
the simulation problems of interest. The model can be used to generate 
predictions of attentional workload as well as of closed-loop performance. This 
is significant because, as noted earlier, pilots may compensate for simulation 
.-Shortcomings but with a workload penalty; such simulation- induced operator 
tradeoffs need to be explored. 

Two approaches to closed-loop modelling are considered. The first employs 
a continuous approximation to the open-loop dynamics of the digital simulation 
in conjunction with the standard OCM. The second model attempts to represent 
the discrete simulation dynamics more exactly. It utilizes a simulation version 
of the OCM. This latter model is referred to as the hybrid model. 


In the remainder of this paper, the closed loop models are described and 
some results of applying the models are presented and discussed. More extensive 
discussion and additional results may be found in Reference 5. 


2. CONTINUOUS CLOSED LOOP MODEL 



> 

I 

| Figure 1. Simplified Model for Closed Loop Analysis of Digital Simulation 

| Figure 1 is a block diagram of a simplified closed-loop model for analyzing 

! problems in digital, piloted simulation. The pilot model in Figure 1 is the 

! 0 CH. 3*4 The elements corresponding to the simulator are an analog" to-digital 
converter (ADC), a digital computer (CPU), a digital-to-analog converter (DAC) 
and a visual display system. Briefly, the ADC is a sampler preceded by a 


114 


\ 








■,---' v ^.d^0te ; « ; ' ■*' 


2Tf ; R»r '■ 7^“T ^ ""M^^TpVTr^fljBP 




low-pass filter included to minimize aliasing effects, the ^ pu 
differenoe equations so as to simulate the vehicle’s response to thepilots 
(sampled)' input, the DAC is a data-hold (either zero-order or first-order) , and 
the visual display system is a servo-driven projector that continuously displays 
targe^^sit ion (relative to the aircraft) to the pilot. These elements will be 
discussed in more detail below* 


2.1 Optical Control Model for Pilot 


Some of the features of the OCM that are particularly relevant to 
subsequent discussions are reviewed briefly here. Figure 2 illustrate 



HUMAN OPERATOR MODEL 


Figure 2. Structure of Optimal Control Model 


•f . 


structure of the OCM. 




h. The OCM as originally conceived and developed presupposes that the sys em 
dynamics, corresponding to the element to be controlled, may be expressed in 
state variable format „ 


x(t) - A c x(t) + B c ti(t) + E c w(t) 


( 1 ) 


y(t) = C c x( t) + D c u(t) 


where x is the n-dimensional state- vector , y is an m-dimensiopal vector of 
displayed outputs, u is the r-dimensional control input vector and w is a vector 
of disturbance and/or command inputs* The system matrices tA c , B c , b c> u c , c 
are generally assumed to be time- invariant, although this restriction can be 
relaxed* The above system dynamics include the linearized dynamics 
aircraft (or other controlled element) and any dynamics associated with 
measurement, control and display systems. The subscript c on the system 
matrices is included to emphasize that the dynamics are assumed to represent a 
continuous system. 

For purposes of discussion it is convenient to consider the model for the 
pilot as being comprised of the following: (i) an -equivalent" perceptual model 

that translates displayed variables into noisy, delayed perceivedvariabies 
denoted by y D (t); ( ii) an information processing model that attempts to 

estimate the system state from the perceived data. The information processor 
consists of an optimal (Kalman) estimator and predictor and it generates the 
minimum-variance estimate ^(t) of x(t); (iii) a set of "optimal gains ,L, 
chosen to minimize a quadratic cost functional that expresses task requirements, 
and (iv) an equivalent "motor" or output model that accounts for bandwidth 
limitations (frequently associated with neuromotor dynamics) of the human and an 
inability to generate noise- free control inputs. 

The time delay or transport lag is intended to model delays associated with 
the human. All displayed variables are assumed to be delayed by the same 
amount, viz. seconds. However, delays introduced by the simulation can be 

added to the human's delay without any problem, so long as all outputs are 
delayed by the same amount. If such is not the case, then all outputs can be 
delayed by T where T is now the sum of the minimal delay introduced by 
the simulation and the operator's delay, and additional delays for the outputs 
requiring them can be modeled via inclusion of Pade approximations in the output 
path. 

The observation and motor noises model human controller remnant and 
involve injection of wide-band noise into the system. This noise is "filtered 
by the other processes in the pilot model and by the system dynamics. It should 
be emphasized that the injected remnant is a legitimate (if unwanted) part of 
the pilot's input to the system and, therefore, significant amounts of remnant 
power should not be filtered out in the de-aliasing process of a valid 
simulation. 


The neuro-motor lag matrix limits the bandwidth of the model response. 
Typically, for wide-band control tasks, involving a single control variable, a 
bandwidth limitation of about 10-12 rad/sec gives a good match to experimental 
results (i.e., a neuro-motor time constant of Tjj • .08 - .10). For many 


116 








A , j>t’-»'>*'-,'' .yyws.VrrJ* “ . - 




pp 


to be obtain*! by wwiU^t' this bandwidth" 1 *d 1 ?h <i '*” red “stlon in error) 
unnecessary control activity. For aTh Sie ” , thera T ** 5<Me ^‘y lp 
bandwidths) have been observed. In Sese cases^Tf th? „ 00nstants < ld »sr 
constant is arbitrarily set at the human's limn (sav T - , , neU! \°-motor time 
of tracking or regulation performance are usuallt ch?,r \P !° 0<l P redl =tlons 
activity and pilot bandwidth tend to h® «, usu f* ly ^obtained; but the control 
useful to have more accurate estimate overestimated. Inasmuch as it may be 

concerning approximations to the discrete ^simulations^ ^ makin8 declsions 
study on the basis of a model analysis of f h was cho3en in this 
control-rate scores. Essentially thi a ( nvft i ^ radeo ^ between error and 
ourve of error-score versus co^^ to «*ep out a 

marginal improvements in performance require substa^ti*? V < alUe ° f T « where 
control-rate (the "knee" of the curve) A vaL t ^ increases in rms 

operator bandwidth of about 1 Hz) was determine approximately .15 sec (an 

out 1 mz; was determined on the basis of this analysis. 5 


“adjJ^ecTrt td^mVr by "hSh ?? rapPaaapt tha «* dP 

performance. The generVl expreseicna fir ,h T? atta ” ,pta t0 ° p “"i*e 
eystem and task and are determined by solvin. “I,® ” 6 " 43 depand on tbe 
problem according to well-defined rniM ne ® an a PP^opnate optimization 

the basic continuous OCM the .sUmator ‘and LS) v int f? at hera la that, d " 
of the system to be contron,d a„d thc con^o °’' < °° ntal " " lDtar ” al "Od.ls” 
knowledge of system dynamlcs The a ss™ B ttor ^ tk 8a . .l are °°“ putad »aasd on 
dynamics during training.* ptio 1 that the °P er ator learns these 


controls a discrete simulation of a ? nominally * m ° del Wh ® n the human 
appear that if the operator is trained on t£ i C ? n “ nuous It would 
model corresponds to the simulation model * J im »A afcior ? ’ then the appropriate 
employed with the continuous model*. * X * This Wl11 be the assumption 


optimization'probl^ yields predictions ^cTf the^om 1 ^^ 011 t0 the tinned 
statistics of the system. Predictions of n-iiot h P !u c i° se d-loop performance 
and error spectra are also available ? aii^^m*?? f “ nctions and control 
performed using covariance propagation methortt fw l ° al co °P ut ations are 
simulations. This la not tho’oL ^ 


from tha that the extsrnal model differs 

••If the simulation mlLf f #M# to s ° od Performance prediction. 6 

the actual system could be learned ^ith ^eaativ 8 * 6 ^ i hat iS ina PP ro Priate for 
training. This l,.„. „„ b. 



2.2 Open-Loop Simulator Dynamics 

' The application of the standard OCM to closed-loop analysis requires a 
continuous state representation of the complete controlled element. Since the 
human pilot in closed loop control will operate on essentially continuous 
outputs to generate continuous control inputs even when digital computers are 
Used in the aircraft simulation, it is meaningful to consider a continuous 
transfer function approximation to the open loop simulation dynamics. Such an 
approximation is developed here. It consists of a rational transfer function 
multiplied by a transportation lag. The rational transfer function approximates 
the amplitude distortions introduced by discrete integration of the flight 
dynamics. The delay accounts for all the phase lags introduced by the simulator 
components. These phase lags are the major source of degraded performance and 
increased workload in closed loop tasks. However, the amplitude distortions can 
be significant for open- loop responses. 

System Function From Stick Input to Displayed Output 

Figure 3 is an elaborated diagram of the simulator portion of Figure 1. 
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Figure 3. Open Loop Simulator Dynamics 

Note that the output of the visual servo, y(t), is a continuous signal as is the 
input, u( t) , to the A-D dealiasing pre-filter.* For analysis purposes we use the 
notation implied in Figure 3. Variables or functions with argument s represent 
Laplace transforms and those with argument z correspond to z- transforms. The 
starred quantities correspond to Laplace transforms of impulse sampled signals 
or of functions of z and are defined, e.g., by? 


u. 


Ms) « Ul (z) 


z=e 


sT 


| l uMs+jnG) 
n=-°° 


( 2 ) 


or 


•For VtopTicityT we' consider single- input, single-output systems. The results 
obtained here can be generalized to more complex situations. 
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n*(s) = D(z) 


where T is the sample period and 
8 = ^ = sampling frequency 

From Figure 3, we obtain 


(3) 


(4) 


I 


y(s) = F 2 (s)y 1 *(s) = F 2 (s) D* (s)^* (s) 

1 °° 

= F 2 (s)D*(s) | l Fifs+jnJDuts+jnG) 


(5) 


n=-» 


Equation (5) gives the exact transfer relation between u(s) and y(s). 
However, it is not a useful expression from the standpoint of closed-loop 
modeling because of the infinite summation. 


The system function for a linear system (such as the simulation system 
under analysis) may be obtained by computing the steady-state response of the 
system to an input of the form exp(st). It is shown in Reference 5 that the 
system function from u(s) to y(s) (in steady-state) is periodic in time with a 
period equal to the sampling period. However, if the output y(t) is considered 
°* i.u instants, which amounts to introducing a "fictitious** sampler 

V**., output ' then the following time-independent transfer function is 
obtained. 


G(s;t) 


sample 

times 


G(S) * F 2 *(s)D*(s)F 1 (s) 


( 6 ) 


We shall consider G(s) defined in (6) to be the 
the simulation. Note that F 2 *(s) = (VHi)*(s). 


"exact" transfer function for 


Equation ( 6) is intractable for use with the continuous OCM. 
will be necessary to approximate (6) for closed-loop 
straightforward approximation is to ignore all but the n=0 
expression for ? % * which results in 


Therefore, it 
analysis . A 
term in the 


1 




( 7 ) 


G(s) * VC) Hi 

T = — ± _ 1 


(s) 


In utilizing (7) it tHu ■ 

d01 " 8 thu *• D. ( „, tbe prooedure for 

~r ration. f or the 


P,(8) = 


V 


S + 2w c s +2w c 2 s+o c 3 


( 8 ) 


V(s) 


w 2 

_ n 

~ 2 ~ o 

s +2?w s+w 4 
n n 


(9) 


The hold transfer function is either 


H q(s) = 



or 


( 10 ) 


H(s) = T (1+Ts) 


l- e ~ Ts 

Ts 


2 


(11) 


£28. ' °?r ld,r * d - cover 

5»z. The chosen on tha”,i,“f t^T!' lf *•» «SS? 

*« J • . 707. « * r, ° d,n “ lM » f ‘«*™.t are oharLu'C’^ > 

™ n s 25 rad/aec 
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where 


V(sj q; e V 
H c (s) * e" T o s 
h^s) a e _T i s 


2 _ 2T 

0) 17 
c 


* Uwj " 1 = - 057 sec 


t q = T/2 


T 2 = T 


Substitution of (12) into (7) yields 


F 1 (s)D*(s)F 2 (s) « D*(s) exp ~|(t p + t v + x i )sj 

where i s 0 or 1 for the zero-order or first-order hold, respectively. 


2.3 Effects of Discrete Integration 

In the previous section the transfer function D*(s) was left unspecified as 
was the manner in which it was to be approximated for continuous closed-loop 
analysis with the OCM. In general, D*(s) will be a "distorted" version of the 
continuous system dynanfios that are to be simulated. Some general features of 
the distortions introduced by various integration schemes are analyzed and 
presented in Reference 5 along with results pertinent to the F-8 dynamics that 
are to be analyzed later. Here, we present a brief discussion of the general 
effects of discrete integration followed by a description of the method that 
will be used to approximate D*(s) in the continuous olosed-loop analysis. 

Consider the continuous vehicle-dynamics as described in the state-variable 
form of Equation ( 1 ) . For' constant system matrices , the transfer matrix between 
system outputs and control inputs is given by 

y(s) * %(s) u(s) 


ib(a) « ♦ »o 

When equations (1) are "integrated" digitally, they lead to a discrete 
approximation with the following transfer matrix* 


D*(s) = {c. [zI-A.]" 1 - B. + D.} 
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where the matrices in (16) depend on the particular integration scheme and 
sample period as well as on the corresponding continuous system matrices. 
Several points concerning Equation (16) are noteworthy . First , the elements of 
the discrete transfer matrix D*(s) , cannot, in general, be expressed as the 
ratio of two polynomials in s of finite degree. Second, the Bode responses 
corresponding to (16) will differ from the continuous responses in both 
amplitude and phase; and, further, the responses for the discrete system are 
periodic in frequency with period equal to 2 tt/T . Third, the 

poles and zeros of Equation (16) are infinite in number and are given by, for 
example, 

P. * <J. + j (w. + 2irk) ? k = 0, +1, +2,... 

1 X A 


Moreover, the principal values for the poles and zeros, i.e., those with k s 0, 
are not, in general, equal to the corresponding poles and zeros of the 
continuous system. Finally, simple integration schemes, such as Euler, will 
have the same number of principal poles as the continuous system, whereas 
multi-step integration schemes, like (Adams-Bashforth) , will introduce principal 
roots that are spurious. 

We now turn to the problem of approximating D*(s) so that the continuous 
representation of the simulator dynamics may be completed. Because of the 
restrictions imposed by the OCM, we restrict the possible approximations to the 
following form: 



DV.IS) 


j (s) e 


- vs 


whereas) is a ratio of finite polynomials in s with numerator degree less than 
or equal to the degree of the denominator. Note that the same "computation" 
delay, % c is associated with each transfer function. This turns out to be a 
good approximation for the dynamioa considered in potion M. If different 
delays were needed, they would be included in D via a rational Fade 
approximation. 5 


The simplest approach to selecting D is to use (15) and let 


* * c (s) ° 
ij 

From the standpoint of the OCM, this means that the state equations for the 
original dynamics are used and discrete integration is modeled by adding a delay 
determined from the phase distortion. As has been stated earlier, such an 
approximation probably accounts for the major source of difficulty of discrete 
integration in closed-loop control. However , to employ it exclusively is to 
leave us somewhat uncertain as to the closed-loop significance of the amplitude 
distortions. 
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(19) 

niV,r«Vr1o!S. SETUT JTtnV*l££ integration, . 

mt jsjrr- » v»x 5L5S £ 23 

representation of D and the values for % J of the OCH is sufficient 

sample periods, etc. For each condition, a ^ of pUo t parameters, 

to predict the corresponding the sensitivity to pilot attention 

specifically observation noise levels, atiows * 

to be examined . ° 
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The approach to developing the hybrid model is to "simulate" the 
closed-loop simulation. A discrete simulation version of the OCM 10 was used in 
a closed-loop digital Monte Carlo type computation* in which "continuous" 
elements of the loop are updated at a rate significantly greater than discrete 
elements. In other words, the hybrid model is a multi-rate sampling system, 
rather than a true hybrid system. (Informal experimentation indicates that a 
sample rate five times that of the discrete elements is adequate to simulate 
continuity for the cases considered here.) In addition, to different sample 
rates for continuous and discrete elements, the updating of the discrete 
equations of the hybrid model is different for the two kinds of elements. In 
particular, discrete elements are updated by means of the integration scheme and 
time-step specified for the "true" simulation. The equations for continuous 
elements are updated at the faster rate via transition matrix methods. 

The equations describing the hybrid model are quite complex and are 
described in detail in Reference 5. Here, we simply note two features of the 
model that are interesting and useful in subsequent analyses. First, the hybrid 
model was implemented so that the prediction time in the predictor of the OCM 
(See Figure 2) could be selected arbitrarily. This contrasts with the standard 
OCM in which the prediction time is always equal to the time delay. This 
additional freedom allows us to "sweep out" curves of performance versus 
prediction time. Theoretically, best performance should be obtained when the 
prediction time is equal to the sum of the human’s delay and the simulator’s 
delay, i.e. when the operator compensates optimally for both delays. Since the 
human* s delay is an assumed parameter , the compensation time for best 
performance yields an independent measure of the simulator delay. 

A second feature of the hybrid model is that the internal model for the OCM 
need not be the same as the system model.* This flexibility provides the hybrid 
model with a capability for examining transfer-of-training questions. In 
addition, sinoe optimal performance should correspond to the operator's model 
being equivalent to the system model, the hybrid model can be used to evaluate 
different (internal) approximations to the discrete simulation. 

A final point concerning the hybrid model is worth noting. Because it is a 
Monte Carlo model, it normally will require many computer solutions to obtain 
meaningful atatistios. In the analyses to be performed here, however, we are 
interested in the steady-state response of stationary systems. Rather than 
average over many Monte Carlo solutions, we have assumed ergodioity of the 
processes and utilized time-averaging of a single response. Even with this 
simplification, it is fairly expensive computationally to obtain valid 
statistical results. 5 


•A truly hybrid (analog/digital) model is possible but would require a hybrid 
oomputer (which was not available). 

•Indeed, the system model oan even be nonlinear. 
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4. AM EXAMPLE 


The models for closed-loop analysis of simulator effects have been applied 
to an "example" simulation involving air-to-air target tracking. Results have 
been obtained for both longitudinal and lateral control tasks, for augmented and 
unaugmented dynamics and for different target motions. In addition, the effects 
of changes in design parameters of each simulation component have been explored. 
The full range of results may be found in Reference 5. Here, a sample of the 
results is presented to show the extent of the simulation effects and the 
capabilities of the closed-loop models. 


4.1 The Tracking Problem 


Figure 4 shows the geometry of the air-to-air tracking in the longitudinal 
plane. The gunsight is assumed to be fixed and aligned with the aircraft body 
axis. For longitudinal tracking, we will assume that no information concerning 
the target’s pitch angle, ♦ nor the relative aspect angle is available. The 
pilot's task is assumed to be that of minimizing the mean-squared, line-of-sight 



inertial REFERENCE 


Z t * INERTIAL LINE-OF-SIGHT ANGLE (ELEVATION) 

R * target range 


«v* ELEVATION TRACKING ERROR *2^-0 


Figure 4. Target Geometry 


traoking error < y 


The target is assumed to execute random vertioal evasive maneuvers. In 
particular, target altitude variations are generated by passing white, gaussian 
noise through a third order filter as illustrated below. 
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By selecting the covariance of the white noise and the cutoff frequency of the 
Butterworth filter, ms altitude variations and nomal accelerations Bay be 
specified. Here, a cutoff frequency of t * *5 rad/sec was used and the noise 
covariance was chosen to give an ms altitude variation of 2 $7 ft, and an ms 

^i 6 tf i0n °f, 3 \! g * 0f 00Ur#e ’ the linearit y ol the problem allows us to 
scale the results to correspond to higher or lower accelerations. 

*w Th ! lon 6 itu<Jinai short-period dynamics of the F8 without augmentation will 
he the baseline dynamics. The relevant equations may be found in Reference 5. 

I^!rnMir, P » eri ? d d I naB !°f have a n#tural f requenoy of 2.28 rad/ sec and a damping 
coefficient of .29; this represents poor short period handling qualities.* 

Because of this, and because we are interested in the effects of simulation 
parameters as a function aircraft dynamics, a set of augmented longitudinal 
dynamics will also be considered. A pitch command augmentation system (CAS) is 
used to modify the base airframe characteristics. The CAS design is a modified 
version of the design proposed in Reference It. 

uoh I'll th ® augmented dynamics are given in Reference 5. The F8 
with the pitoh CAS has short period roots with a natural frequency of 2.78 
rad/sec end a damping coefficient of .64; this constitutes a significant 
improvement in the short period handling qualities. 2 8 


5. MODEL RESULTS 


$.1 Continuous Model 


The continuous model was used to analyze the effects of both simulation 

0 7rr TriT'? i V nt rUb \7' Wi 7 rwpeot t0 the 8iBulation » the effecta 
r»c 8 /7r Pl t an J Integration scheme are presented for the longitudinal 

C C Ato 0 FF F STSSm results? ^ *" *' 

which the cutoff oi^the ^a^^ pl7^JueioJ? 
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Figure 5. Effect of Diecrete Simulation on Normalized Performance 

funotion of sample period^nd* 1 inte*ratio° e *** th ® baaic oonfi 8uration as j 
defined as the tracking error obtain^ f^the Mmu’i f N . onnalized Performance U 
by the tracking error that would be obUined in l r^M 0 ” COnflgur#tion divided 
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performance utilizing the original continuous i *»^ ten8i ?! d by C0 ®P utin « the 

only 0. 1«, U turn of the operator ( .2 nmrt s) . ,qu ‘ lim ’ «*> a»au»ln* the 

partloiarty Vtw a S Mpl«"ritia* rr to« fer by th * •‘■“»»Mon, 

♦ 03125), there is a 16-20 percont * Derfora*™* ) he ^ igbest 5aa P le rate (T * 
magnitude exceeds the normal intra^anH degra dation. A change of this 
tracking tasks and would therefore’ be V#riabUlty *« ».nusl 

tracking atandpolnt, A-B Jot.Br.ti™ 1,’ aoperior trLu* 1 ;„u“.u^: M<i ' l00P 

Mault^iT^ t ?hi^l^5!utlL*i^^tn t ^oo™M. 0 "l 1, MJ “ 8 *” nta 1" Pilot strategy 
for al.ul.tor delay, and thead'otloo tlM t0 «=»P«n«U 

amplitude distortions (and pole perturbationsT ^f”^ 1 ^. hat * ocount3 For the 
faults are based on the assWtioro? a fi «d i by tha cpu * The 

^r V ?K’ th K e pilot My c »o°se to devote^aore^ttenUtw to Vh ? nt l°? throu tf»«** 

tnd, thereby, reduce traoking error, a reasooahV. taak (work h «rder) 

How much more attention to the task would ht * W « q “ e,tlon to ask, then, is 
levels comparable to those that could * obtained^ to »<*ieve performance 
This question can be addressed us<n« m<. j , » d * n a con tlnuous simulation? 1 ' 
0CH.9 The reault of SSXZM'SZ'S; W °^ 


•As might be the case in an all 
undelayed visual information. 
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Figure 6. Simulation Workload Penalty 

It can be seen from Figure 6 that to achieve the performance equivalent to 
that for continuous simulation, the pilot would have to increase his attentional 
workload by factors up to three for the conditions considered. There is a 
substantial workload penalty and it might be expected that a compromise between 
performance degradation and increased workload might evolve. This would be the 
case, especially if the pilot had not flown the vehicle or a continuous 
simulator in the same task so that there would be no basis for setting a 
criterion level of performance. 

Before leaving the workload question, a further point is worth noting. In 
the describing function literature, it has been common practice to associate 
workload with the generation of lead. However, there has been no quantitative 
connection between the amount of lead and the increase in workload. In the 
present context, one can think of the increased prediction time necessary to 
compensate for simulator delays as imposing a (processing) workload analogous to 
that of lead generation. The measure of attentional workload given previously 
may then be thought of as an alternative means of quantifying the workload 
imposed by the requirement for additional prediction. 

It was anticipated that there would be an interaction between the effects 
of simulation parameters and problem variables such as vehicle handling 
qualities. Thus, the above traoking task was analyzed for the CAS/ON 
configuration. 

Figure 7 compares normalized longitudinal CAS-ON and CAS-OFF performance 
for the basic simulation. It oan be seen that the CAS-ON performance is 
degraded more by the discrete simulation than the CAS-OFF performance. These 
results are explained by the fact that the delays introduced by digital 
integration are larger for CAS-ON dynamics than they are for CAS-OFF dynamics. 
The effects of longitudinal dynamics when viewed in terms of absolute 
performance are interesting and are also shown in Figure 7. The absolute 
performance for continuous simulation is better for CAS-ON than CAS-OFF (by 
about 3.5 percent) and the sensitivity to incremental computation delay is about 
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Figure 7. Effect of Vehicle Dynamics 

the same for the two configurations. Thus, for a given simulation 
configuration, absolute performance for CAS-ON and CAS-OFF configurations will 
be about the same if Euler integration is used and the CAS-OFF configuration can 
give better performance if A-B integration is used. In other words, the 
discrete simulation washes out any improvement due to the CAS! 




5.2 Hybrid Model 


The hybrid model was used to investigate several issues that could not be 
examined readily in the continuous model context. Results were limited to the 
longitudinal unaugmented dynamics because of cost and time considerations 



Figure 8. Effect of Operator Prediction Time 


- f! i8 K re < 8 S ?° W f h h ® sen3itivit y of Performance to delay compensation time* 
for the basic simulation configurations with both Euler and A-B integration and 


•The prediction time in excess of that needed to compensate for the operator’s 
intrinsic delay of .2 sec. 
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optimal prediction times to be approxima e y q Figure 8 For Euler 
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integration the minima occur at .26 see and .2 sec. ior 
respectively; the corresponding simulation delays are .27 and . 9 
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that for this case a delay compensation pre - filter and zero-order 

corresponds to the delays introduced y noorer than for the case with 
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should not be viewed here as a workload penalty. 


required maylmpoae a workload penalty as noted earlier. 
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correct one). * f *he prater opt the delay compensation 

degraded by about 10*. If, on the rfo ° mance ; ity of about 19 | will be 

Ve effa'ot is ~t substantial her. but it might he in other tasks. 
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Figure 9. Effect of Internal Model 

is shown in Figure 10. ^Euler integration of* the" 31 m 81 ," 8 filter on P er fonnar 
other simulation parameters correspond Vo tvV ? vehicle equations is used a 
are for a sample frequency of 10 Hz (t ii basic configuration. The resul 
satisfies the Nyquist reLirJL* I * 1} 80 a cutoff frequency of«l , 5 

^respectively. The lowest value of^? 2T^z°V t P 1 baLd f ° r * ,C *K 5 and 
that there is not significant ^ ase( * on the assuapti 

set the filter bre.k-^int’t 5 " 2 ~ d » no neid 
results in Figure 10 f«*or Mini r1T y *" d lnour the del *y Psnalt T . T 
this problem. Furthermore, there is freq 1 u ® noy » < ^ * 20 Hz * f 
frequency cutoff. These two results iiniPVhA li i V ? enalty for usin 8 the 1« 
We a lso note that the performance minimi fori - 20 «*? * pr ° bleB her< 
the oorreot value of prediction tine; the oStl^^lSuo’ UaHo" c ‘V?°i 
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is much larger but not quite so large as the estimated total simulation delay of 



Figure 10. Effect of Dealiasing Filter Cutoff Frequency 


.53 seconds. 

The effects of using a first order hold instead of a zero order hold are 
shown in Figure 11 for both Euler and A-B integration at T s .1 and for Euler 
integration at T * .0625. The corresponding best zero order hold performance 
values are also shown for comparison purposes. At a sample period of .1 
seconds, slightly lower tracking errors are obtained for Euler integration with 
a first order hold than with a zero order hold; in addition, the minimum 
performance is obtained with less delay compensation. The situation for A-B 
integration and a .1 second sample period is the reverse of that for Euler. 
That is, for A-B integration the first order hold degrades performance. 

A possible explanation for these results is as follows. The first order 
hold uses intersample information which provides some lead. For long sample 
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• ZERO OROER HOLD 



DELAY COMPENSATION (**c) 


Figure 11. Effect of First Order Hold 

periods and Euler integration, the effective lead provided is apparently more 
than the lag penalty associated with the higher order hold. The 
beneficial effects of a first order hold should decrease as t _he sample per: Lod 
decreases. This is supported by the results for T * .0625 .. . 

difference between the two holds. In the case of A-B integration the added 
delay of the first order hold dominates. This may be due to A-B 
htviig an implicit first order hold at the input, thereby reducing any advantage 

in adding such a hold at the output* 
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6. SUMMARY AND CONCLUSIONS 


In this paper we have examined the effects of simulation parameters and 
components on simulator fidelity, particularly with regard to predicting 
operator performance and workload. Our focus has been on the dynamical aspects 
of simulator primarily as they relate to closed loop control. We have generally 
ignored questions that would necessitate inclusion of detailed models for cue 
perception leaving these to future study. 

An approximate continuous model of the discrete simulation was incorporated 
in the standard optimal control model for the human operator. The resulting 
continuous closed- loop model was used to analyze both overall simulation effects 
and the effects of Individual elements. The results showed that, as compared to 
an ideal continuous simulation, the discrete simulation could result in 
significant performance and/or workload penalties. The magnitude of the effects 
depended strongly on sample period as expected. From a closed-loop standpoint 
it seemed clear that A-B integration was much to be preferred. With respect to 
the other simulation components it can be said that any reduction in delay is 
desirable. Such reductions inevitably involve increased costs (ha"dware or 
software) which must be balanced against the expected improvements. 

In addition to the continuous model, a hybrid model was developed to allow 
investigation of situations that could not be treated adequately with the 
continuous model. Several interesting results were obtained with this model. 
It was shown that for this (fairly typical) aircraft control problem signal 
bandwidths were such that the de-aliasing filter cutoff frequency could be set 
at a value greater than half the sample frequency. Also, there appeared to be a 
potential under certain conditions for improved simulator performance with a 
first order hold (rather than a zero order hold). The model was also used to 
show demonstrable effects for adopting the simulator dynamics as an internal 
model. The need to compensate for simulator delays via added prediction was 
also shown. 

We believe the models developed here oan be very useful in developing 
engineering requirements for flight simulators. These requirements will be 
problem dependent which is one reason why models are needed. As we see it now, 
the process for using the models would involve the following steps: 

i) Use standard OCM to analyze ideal continuous simulation to develop 
baseline performance and to determine expected signal bandwidths. 

ii) Analyze distortion introduced by discrete integration schemes and 
develop continuous models for discrete dynamics valid over the band of 
interest . 

iii) Analyze effects of integration, cue dynamics etc. using continuous 
model . 

iv) Use hybrid model to examine effects of data reconstruction, 
de-aliasing cutoff frequency eto. 
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Before this procedure could be used with complete confidence the models 
described herein need further validation and extension. It is especially 
important to collect data in a carefully controlled experiment to verify the 
individual simulation effects. 
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